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(57) Abstract 



A computer display displays a data flow network as a plurality of interconnected units. An interactive program allows the 
appearance of the plurality of interconnected units to be changed. The data flow network then is automatically altered to corre- 
spond with the visual changes. 
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IMPROVED METHOD AND APPARATUS FOR CREATING VTPTUAL WORLDS 

5 BACKGROUND OF THE INVENTION 

This invention relates to virtual reality systems 
and, more particularly, to a method and apparatus for 
creating a virtual world. 

Users of computer systems are now able to create 
10 virtual realities which they may view and interact with. 
One type of virtual reality system is disclosed in U.S. 
patent application No. 535,253, filed June 7, 1990, entitled 
"Virtual Reality Network," the disclosure of which is 
incorporated herein by reference, one task which must be 
15 performed is the creation of the virtual worlds within which 
the users interact. This can be a very tedious task, since 
a complete description of all virtual objects in the virtual 
world, including their constraints of motion, hierarchy, 
color, texture and other attributes must be made and entered 
into the virtual reality computer. Thus, it is desirable to 
make virtual world creation as simple as possible. 

One product used to create virtual worlds is the 
"Body Electric" program discussed in the above-identified 
patent application. The Body Electric program allows the 
user to create virtual world hierarchy trees and to couple 
data (real world or synthesized) to the tree nodes. Further 
details of the program maybe found in Appendix 1. 

SUMMARY OF THE INVENTION 
30 Tne Present invention is directed to an improved 

method and apparatus for creating virtual worlds wherein 
users may manipulate pictorial objects on a computer screen 
to effect complicated operations on the virtual world 
database. In one embodiment of the present invention, a 
35 computer display displays a data flow network as a plurality 
of interconnected units. An interactive program allows the 
appearance of the plurality of interconnected units to be 
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changed. The data flow network- fh« 

alt*™* * necworjc then is automatically 

altered to correspond with the visual changes. 

5 - BRIEF DESCRIPTION OF THE DRAWINGS 

and 1,19 to the P"sent invention; 

^or^^^^^ZT -ch 
10 to the present invention. Matures according 

BRIEF DESCRIPTION OF THE APPENDICES 
15 databases; creating virtual world 

present invention; and matures of the 

int.™- APPSndiX 4 15 3 S ° UrC6 C ° de listin * of an 
mterprocessor editor according to the present invention. 

DESCRIPTION OF SPECIFIC EMBODIMENTS 

referred to in *-h~ . snould be 

ea to m the discussion which follows. 
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The Names Window 



The introduction of the Names window is one of the most fundamental 
changes of Body Electric 17b3. This window replaces many of the 
functions that the DM dialog box originally performed 

It might be useful to have Body Electric running while reading this. Just 
stan up BE 2.7b3 and open a 'New' file (from the Bit menu). Body 
10 Elecmc will ask you if you want to create a Tree or DM file. Choose DM. 



The "Type" List . 
rav I dm U)ph< 



Below is the Names Window with the 'type* box selected. This window 
is invoked by selecting "Names'* from the Window menu. 
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A listing of available raw inputs wiU appear when this bar ;< rk. t . 
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5 



basically the same process as was done to drag the DM out Click down 
on the raw input you need and drag it dose to the DM input (on the left 
side of the DM) that you wish to connect it to. When the raw input is 
within connecting distance, the input box it is closest to will light up. By 
releasing the mouse button, the raw input should connect itself to the DM. 
Another method of connecting a raw input to a DM is to dick down on the 
DM input and then select the raw input needed. When the mouse button is 
released, the connection should be made. 

Thg 'Tree" Mitf 
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roll 



When the tree box is selected, a listing of the tree nodes from the Swivel 
file that is activated will appear. The tree file below is from one of VPL's 
worlds named "Kitchen*. Tree node inputs and outputs can be connected 
to DNfs in the same fashion as raw inputs are. One thing that is slightly 
different is that when using tree nodes as inputs or outputs, the user must 
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it can be very useful to be7bfe to ^ ^.rT^. 1 ? 0 ^ for * *P«ifie DM 

see the tree structure of a worldill wn„M M ' ple ' tf *° u were » 
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The "dm" Mfiflnr 
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Highlighting the dm box will show a list of the DMs that are in the active 
DM file. When you create a DM and name it , it will appear in this menu. 
With 'dm' comes the numbers 1 through 6 in the lower half of the names 
menu section (see above). 

The dm menu item is useful as a time saver. Instead of searching through 
your file for a DM, you can find it here and use it as an input or output 
Just select the in or out port (1-6) that you wish to use ana then use this 
list like you would use the "raw" and "tree" lists. 
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The six bottom boxes in the Names Window menu are modifiers. 
Modifiers appear in three cases: with the Tree, Type, and DM lists. These 
modifiers specify either the degree of freedom or the number of the input 
depending on the list chosen. For example, when creating a set of DM's 
that will move an object in VR, Body Electric usually needs to know what 
axis of the object should move. Do you want the object to move along the 
x axis, or do you w$nt it to roll? In order to use the correct "axis" of an 
object, select x, y, z, yaw, pitch, or roll before "grabbing" the desired 
node. In the same way, choose the number of the input or output you are 
using. 



The "Flex" Window 



Body Electric 2Jb3 now allows the user to have more than one window 
open at a time. Because of this, the menu items "Flex" and "Tree" from 
the Windows menu no longer exist. In place of this. Body Electric now 
lists the names of the files that are open. To open a DM file (what used to 
30 be opened by "Flex" in the Windows menu) called name, choose 

name.DM. To open a tree file (or the Swivel file), choose name. 
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IS? 0 mm , to™ whkh ^ DM file to run at any point in 
£2^. C m " Iap,e ? M te ^ simultaneously, the user must 

J^r? Ch f ck whcth 5 r * ffle « activated or not. look in the Windows 
menu. Files that are active have solid diamonds to the left of SS 
Libraries and Nested DM's that belong to activated fikSm hoUow 
diamonds next to their names. 



BE WnrbhAnffr Tftnh 



20 



25 



30 



35 



id! 



♦Untitled2.DM 
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This is a picture of a new DM window. On the left hand side of the dm 
wtndow are 6 tool* Rom top to bottom meyarenaSed Se Selict ,Sf 
the Hand tool, the On/Off Switch tool, me Ca^bratewol fit's s fwrench * 
the Input/Output tool and the DM description tool 



The Select tool is the default tool for DM windows It onentee in t h. 
same fashion as the standard Macintosh m^S^Sta^SSSLb^ 

° • lt U 1° * Ie 5 severaI 'sin the same an^ pS a bw^t^'und 
the desired boxes. To select more than one DM one bvrmJ 
the shift button while clicking on the desired DM's * * h ° ,d d0Wn 
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With the Hand tool, the user can "grab" the workspace within the DM 
window and slide it around like a sheet of paper on a desk. This is an 
alternative to using the scroll bare. 



The On/Oft Switch looi allows the user to turn DM's on or off very 
quickly. There are two ways of using this tooL One way is to select the 
On/Off tool and then click on the DM that needs to be turned on or off. 
Another way allows the user to turn on or off multiple DM's 
simultaneously. First select the DM's you want to change (see the Select 
Tool). Then hold down the mouse button on the On/Off tool until it starts 
blinking. When you release the mouse button, the selected DM's will 
either be turned on or off. 



The Scissors tool, is used to break connections that already exist 
between DM's and other DMs, Tree or Raw inputs. To use this tool 
select it and then click on the input pad you want to disconnect. The input 
that's going into that tab will be disconnected and the tab will go to it's 
default if it has a default or if not the DM will be turned off. 
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The Wrench, or Calibrate tool, is used to set the internal information of 
a DM. For example, when calibrated, the Scale/Offset DM presents the 
dialog box below. Not all DM's have calibration boxes (e.g., 3Times, 
Average Two f Cube) 



Fined Scale/Offset DM module 'UPL 
Research*. 



And the new offset value: 



0.00000 



Cancel 



35 



The Input/Output Tool lets the user modify the number and type of 
inputs and outputs for each DM. To use it, select this tool and click on 
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DM of type Integer. To do this, click down on the third box down in the 
left most column. The following menu will appear. 

unused 

Integer 

Long 

Fined 

Real 

Point 

Same 

Polntllst 

undefined 

By selecting "Integer" and releasing the mouse button, the integer inputs 
will now appear both in the dialog box as well as on the DM itself. The 
same method can be used to change the type and number of the outputs. 

Note thai by changing the inputs of a DM, the outputs usually are altered 
automatically based upon the DM being worked on. 

And finally, the bottom-most box contains a description of the DM. 



By selecting the DM Description Tool and clicking on a DM, a 
description of the DM will appear across the top of the window. This box 
describes what the DM does. It is useful for finding out what a DM does 
as well as for double-checking what any specific input is used for. 
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u^h?^? Ut DW L networks ^ exists inside other DM networks 
When the outer network executes, it calls the Nested nM t.kLu . 
it's network, and if it in turn ha^e^Ws Kfe kaZ » "ST* 

Nested DM has one input which determines if the N^edDM^inS^ 

The Library DM is a special case of a Nested DM. In thte ck* th» niu 
network exists inside another DM file. iSj^wS^ifiiSS. 

by creanng a Library DM that refers to the dedred library fi£. tw« TrSS 
mSS^S ****** .include con^Tand^eneTaJ^a M 
Sl ModuJ « "to her or his program without too muTh Sef Thic 

I^e h on*u^ 
Additional Features 

W^ 1 *? B?X - J ' Th !? ^ ** has a new checkbox called 'Global 
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network wont react to mouse movements as jw mSSfi? 
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► Swivel IPC Specifications 

* Brief Description 

► The Swivel IPC (Inter -Process Contuni cat ions) has been 

designed to allow external editors access to Swivel3D worlds 
5 while Swivel is running. With it we have the ability to come 

up with new ways of creating and editing 30 solid objects. 
Swivel can always draw any object as a list of polygons But 
to edit an object Swivel looks at the objects type. If it is 
a standard swivel lathe object swivel calls it's internal 
1U editor but if it is another object type swivel tries to 

launch the associated editor and passes a message to edit the 
given object. When you launch Swivel under Multifinder it 
runs as one application (program) . Under MultiFinder there 
1C can be a number of applications launched at the same time. 

li3 the user tells swivel to edit an object which uses 

another editor swivel looks up the name of the editor 
application and tries to launch that. If successful swivel 
posts a message in the SwivlPC for that editor which tells 
~ n the e^tor to edit the object. The editor edits the object 

^ u 311(1 tn © n posts a message back to swivel to check the object 

back in. Swivel reads the object back in and updates it's 
database of objects. 

► The way messages are passed is through a resource called 
„ 'YPJK\ o which is in the system file and is accessible to 
" all applications. This resource doesn't normally exist so 

the first time SwivlPC is used the resource has to be added 
to the system. 

► Since any application can access the message passing resource 
. n we wanted a way to protect our rights to the technology. 

JU Swivel will ignore messages from any editor until the editor 

has tt registered" . This gets reset each time swivel runs. 
"Registering" means that the editor has to send a register 
message with a pointer to the string "Unauthorized use is 
subject to legal action." Until the editor does this swivel 
3 will ignore any messages from the editor. 

> Message passing scenario 

* User double -clicks on a object that is edited by the terrain 
editor (#67) . 

► Swivel tries to find and launch 'Terrain Editor' . Swivel 
0 also post a message to number 67 saying edit the object at 

location $xxxxx. 

► The Terrain Editor starts running and looks in the system 
resource for messages. It sees that there is a message from 
swivel to it to edit an object. It sends the registration 

:> message back to swivel and brings up a window so the user can 

edit the object. 

► When the user is done. and has clicked OK the terrain editor 
sends a message back to swivel to check in the object the 
user has edited. 

0 ► Swivel receives the message and replaces the old copy of the 

object with the newly edited object. 

► The terrain editor can at this point either quit or hang 
around waiting for some more messages from swivel 

> Possible Messages 
5 ► MsCheckln 

► Check an object into swivel that has been edited bv an 
editor. 1 

► Data, DataLen - Handle to and length of memory in the 
editor for the new object. 

► modifiers: 

► MsCheckOut 

► MsEditObj 

► MsGetCrntObj 
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MsSetCrntObj 
MsDoCommand 
* MsQuiting 

► MsStartFast 

► MsEndFast 

► MsRegisterEd 
message format 

stoS ^omto; /* whom is the message for 7 

15 S ? 0rt whomf 2nn; . / whom is the messaae '/ 

short status; / ipr e message from / 

error. 7 status. Sending, received or 
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nSer m ^ SCOunt '* /* ^ique incrementing message 
short what ; 

loaf Date; /' "52 £T^^ th ? meesase was eent < V 
wan?. 7 ' 0Sed by ^divxdual messages however they 

long DataLen; 

} SwivlPC, *SwivlPCPtr, "swivlPCHanHI*. 

each editor. Swivel iPJT. w&mx Whlch is 'or 

*■ The only other unique address ia i -«.• 

to all editors. Ea?h editor a broa d=ast 

not change the status. ^ ST^ii'S 2" m * BSSLg * but 

» -u-ST. fhe 0 aj ^S°:tSSS g t2 - 1 55r ■ u " t 6et it,s 

frof 13 S3Jne aS Wh ° mt0 but whom the message is 

" J?2 - .Ieh£: CUtrWlt StaCe ° f the raessa * e P a ««g mechanism. 

* 0 - not being used 

* 1 - message has been sent and not receivprf 

► what - The message verb. See above 

- S - e ^: n m ^ i "! de P eada »t on the 'what field. 

DataLen - meaning dependent on the want field. 
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The purpose of the Swivel PC is to allow the Swivel 
interface to be customized and extended for specific purposes. 
Many different editor extensions are possible. The one 
implemented in the code provided in Appendix 4 is called the 
5 Orientation Editor. 

The Orientation Editor allows those aspects of the 
Swivel file used by Body Electric for the RB2 Virtual Reality 
System to be edited and stored within the Swivel file. These 
aspects include point attributes like bound, cube, line, 
10 LineDown, or Line Right, which determine how the point is 
rendered in Body Electric, as well as enabling particular 
degrees of freedom (Roll, Pitch, Yaw, X, Y or 2) to be output 
serially to another [host] computer. The Orientation Editor 
also allows the user to send command scripts to Swivel, to 
15 check all the names of objects in the Swivel file for 

uniqueness, to inherit selected attributes, and to mark, and 
return to world viewpoints. These capabilities enhance the 
user's ability to create Swivel Models for use in RB2 . 

TRhe improved Body Electric software described may 
20 be used for creating a number of virtual worlds. Examples of 
such virtual worlds are shown in Appendix 2. 

While the above is a complete description of a 
preferred embodiment of the present invention, various 
modifications may be employed. Consequently, the scope of the 
25 invention should not be limited except as described in the 
claims. 
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WHAT Tfi rr.a-n^n T? . 

1. An apparatus for creating virtual worlds 
comprising: orias 

display means for displaying a data flow network 
as a plurality of interconnected units; 

means for altering the appearance of the plurality 
of interconnected units on the display; and plUrallt ^ 

10 network *" aUtomatica1 ^ string the data flow 

•lu network to correspond to the a it ot .^ 

Pluralitv < * altered appearance of the 

Plurality of interconnected units 
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